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ABSTRACT 

This study examined effects of five combinations of 
four instructional variables on student learning. Subjects were 168 
graduate students ernolled in a course in educational research at 
Arizona State University, Tempe. The five versions of the 
instructional program used in this study were constructed from cues, 
examples, practice items, and feedback. Cues provided a definition of 
the concept to be acquired, and examples consisted of one positive 
and one negative instance of the concept olass. Practice items 
presented the name of a concept class and four instances of the class 
for subjects to classify. Feedback combined instructional feedback 
and knowledge of correct response. Subjects were given a packet 
containing the instructional material appropriate to one of the 
experimental groups; after studying the material, the student was 
given a 60-item posttest. The study indicates that of the four 
Instructional components investigated, practice and feedback 
contributed the most to subject acquisition of concepts presented. 
(NJH) 
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'J}uJ3 liMiillJOS OF IX)UR lUSTRUCTIONAL OOIIPOmiTS " 'eS^'i'IvrLP^^^^^"^ 

ON CONCEPT ACQUXSITIOir '*''°^Stl&""''' 

^ Patrick B. Stiith i-"?"3,°.'fs%%°Si'«° S 

llarioopa County CowAunity Coiloce District le*;Tl'^p''.?,X?;:TlS^.S^,«^,^l 

EDUCATION POSITION OR POLICY 

O 

lij , 2yS£*i3Cgg« An analysis of the concept learninc literature reveals four factors 
which are recpxded as important in student attainwont of a concept. One suoh factor is 
•the information the learner typically needs at the becinninr; of instruction in order to 
perform a behavior indicated in an instructional objective, Tliis information may be 
presented in the form of a definition, a rule, or a set of procedures, and is termed an 
instructional cue (Sullivan, Baker Cc Sohutz, 1971). Another variable which is important 
during instruction is selected concept e:»mples. The use of examples in instruction ex- 
poses the student to specific instances of the concept class^ a procedure which researchers 

*!?°^=^?G have stronely recommended (Englemann, I969j Ilarkle ee Tiemann, 1969, 
Zu f is also an important instructional variable, Poptom (1969) contends 

that curricular materials eliould contain practice items which provide the student with 
gportunities to encace in behaviors relevant to the desired concept to be mastered. 
I'rovidinc students with feedback after a response is a fourth variable considered by 

mf^^^T'^ (Anderson, 1967? Iliccins, 1972) to be important for effective instruc- 
tion. These four factors may be recarded as key elements of well desicned instruction.' 

hfl«i. instructional cues, ejtamples, practice activities, and feed- 

^ratJSe «f *^ U*'^! ^^^^^^i^ated and reported independently! X cot 

f i 5f!i^!J '^^4®^*'^' ^^'f***'^ attainment and the relationsliip of these 

£jefl?fr^? J T?*^*** ^ .syetematically desicned instructional procram have not been 
to inaiSS^JL I probable that when these four variables aJe syste«atically added 
to instruction, a correspondme improvement in concept acquisition should result. 

4««4.,.i!!?j4JI!!f®"® *** determine the effects of five combinations of four 

cSf^^JJ ?S T^^'^P^^ ''^^^ learning The five combinations investicated Sere 

2^^ vC), Cues-Ejamples (OB), Cues-Praotice (OP), Cttes-E-ARmles-Practicr(CI^). and 
sen?:f?S^^'f:S^«J^ instructional varSSw? Sa?ion waJ ^e- 

researWVit'a^^^^^^^ --^^^^^ • — in educational 

titlefciiSS^SJii**!!!]; ^^^"^ experiment was a procrar.imed sequence en- 

titled Clas^ifyinfi and Interpretinf^ Education Research StuMes (Sullivan. 1970) 

'ZT^Z b^SJ eSif i LT'*'*' T r i- ^ST^.^lk «t arch. 
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The five versions of the instructional program used in this study were constructed 
froc) cuest examplest practice itoms, and feedback. Cues provided a definition of the 
concept to be acquired and the ez^amples consisted of one positive and one negative in- 
stance of the concept class. Practice items presented the name of a concept class and 
four instances of the class for subjects to classify. Feedback combined instructional 
feedback (IFB) and knowledge of correct response (KOR) , IFB consisted of the correct 
response and an es:planation of why the response was correct. IFQ was provided after the 
first negative and the first positive inatai.ce of the concept class included in each 
practice item. KCH indicated only the correct response and was provided after all other 
instances. A control group received a posttest and then read irrelevant material. 

As each subject entered hia dassroomt he was given a packet containing the instruc- 
tional material appropriate to one of the e::perin!ental groups. Tlie packets were random* 
ized within groups of sixt one packet from each treatment condition) prior to distribu- 
tion. Subjects were told to read and study the material in a manner consistent v^dth 
their usual practice. After studying the material t each subject raised his hand and was 
given the posttest. 

A 60-item posttest was used to measure the effects of the various treatments. The 
posttest was divided into six subtest sectionst one section for each of the si:: concepts 
presented in the instruction. Each subtest consisted of ten items and contained pre- 
viously unencountered positive and negative instances of ';he concept presented in the 
instruction. 

Results . Table 1 shows the posttest mean scores for each treatment group on each of 
the six subtests and on the total test. These data were analyzed using Page's (19^3) 
Ii-test to determine if a monotonic relationship existed between the predicted and ob- 
served posttest performance by treatment. The L- test indicated that there was signifi- 
cant agreement between the predicted end observed rankings of the subtest mean scores for 
the six treatment groups (L = 526, p <.01). Table 2 contains the data for this analysis. 
As predicted, the performance of the CEPP group was consistently high on the si:: subtest 
sections while the performance of the Control group was consistently low. Tlie perform- 
ance of the four other groups fell into the mid-range on the subtests and not in the 
exact order predicted. 

Tlie L-test indicates whether or not a significant trend in posttest mean scores 
occurs in the predicted order of performance, but does not reveal whether significant 
differences in posttest performance e>dst between the individual treatment groups. To 
determine if there were significant differences between the posttest mean scores of the 
treatment groups, a one-way analysis of variance of posttest mean scores was performed. 
This analysis yielded an overall significant difference (F = 9.70, df = 5A67, p<.Ol) 
for the six treatment groups. 

A Seheffe test of between-group differences revealed that on the posttest the mean 
score of ^.32 for the group receiving all four instructional components (CEPF) was 
significantly higher (p<.Ol) than the posttest scores obtained by all other groups. 
The Scheff4 test also indicated that the three treatment groups receiving practice, tho 
CSPF, OEt\ and CP groups, scored significantly hi&her <p < .01) than the Control group 
but not significantly higher than the Cues-Eitamples and Cues Only groups. Mo other 
differences between groups were statistically significant « 

There were large differences between groups in the number of errors made on the 66 
practice items included in the instructional, material* The CEPF group made only 
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errors whereas the CEP ^Toup wade 19*^ errors and the OP croup made 21,25 errors. Tlius^ 
the two croups receivinc practice but no feedback (CP and CEP) made between three and 
four times as many in-procram errors as the croup receivins both practice and feedback. • - 
A one-way analysis of variance indicated that the differences in practice errors were 

' = P<o01), The Scheffe test revealed that both the CP 

and CEP croups wade sicnificantly nore errors (p <.01) than the CEPF croup. The number 
Of errors for the CP and CEP croups did not differ sicnificantly. 

Time required to complete the instructional procram was recorded and analyzed for 
all subjects. Each f the three croups receivinc practice took over 37 minutes to com- 
plete their materia , whereas the two no»^practice croups took 16 minutes and 21.^ 
minutes. A one-wa^ analysis of variance of completion times yielded a sicnificant dif- 
ference (F « 53.68, df = k/l7>9i P<.01). A Scheff4 test indicated that each of the 
three croups receivinc practice took sicnificantly more time to complete their profirams 
Cp<.01) than did the two croups not receivinc practice. The test also indicated that 
the croup which received examples with cues (CE) took sicnificantly loncer to coimplete 
the procram (p<.01) than did the croup which received cues only. 'lo other differences 
for time on instruction were sicnificant. 

Discuasion . A comparison of posttest scores from each of the five treatment croups 
indicated that when each instructional component was combined with the instruction, 
increases in posttest performances occurred. An Latest revealed a sicnificant relation- 
ship between the predicted and observed posttest performance for the five croups. How- 
ever, the overall trend in posttest scores v/aa not e::aetly as predicted because subjects 
who received the material containinc only cues and practice items obtained higher .post- 
test scores than subjects who received cues, examples, and practice items. The moiit 
effective combination of variables was the one which included all four instructional 
variables; cueso examples, practice, and feedback* 

Subjects studyinc material containinc cues, examples* practice items« and feedback 
received significantly hieher scores on the posttest than subjects studyinc *he same 
instruction without feedback, Tlie effectiveness of the GEPF treatment was iarcely 
attributable to ineludinc feedback with practice. Two kinds of feedback were included 
in the instructional procram. JFB (instructional feedback) v/as presented followinc 
practice on the first example and none::ainple of the concept and KCR (knowledc© of cor- 
rect response) was presented followinc oil other practice items. One reason that feed* 
back r,iay have been effective was that the combination of m and KCR provided the sub* 
ject with more complete feedback (IFB) at the time when the response presumably was 
beinc acquired and with a briefer form of feedback (KCR) when the response was beinc 
maintained. Tlie IFB in the CEPF condition constituted the second presentation of the 
information needed by the subject to make a correct response since the information wa» 
presented initially as an instructional cue. 

Subjects receivinc practice items without feedback made sicnificantly more errors 
(CP, 21.25; CEP, 19.^) v/ithin their procrams than subjects receivinc both practice 
items and feedback (CEPF, 5*^3) • Clearly« the feedback in the CEPF material had a 
stronc effect on the number of errors made on practice items. However, it is not clear 
how subjects used feedback durinc practice. Sines IFB was presented immediately after 
each set of four practice items, subjects had two additional opportunities to study the 
information which explained why a civen response was correct. In addition to lIBi all 
feedback messaces contained KCR, Tliereforci it is possible that subjects in the CBIF 
croup used the feedback information to determine the correct response before respondlnci 
rather than after respondinc* Recardless of the manner in which feedback was used dur- 
ing practice, feedback had a sicnificant effect on the posttest performance of the CEPF 
Cif'oup. 
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The amount of time which subjects took to complete the procrai.1 increased as the 
number of instructional components in the particular p^oci'Sin version increased. Groups 
receivinc practice items took significantly more time to read their procrams than croups 
not receivinc practice, but they also obtained hicher scores on the post test. However, 
the presence of feedback in the CEPP procram did not sicnificantly increase subject 
study time over the CEP procram, but it did sicnificantly increase posttest scores. 

This study indicates that of the four instructional components investicated, 
practice and feedback contributed the most to subject acquisition of the concepts pre- 
sented. These results are in contrast with recent research (Tenpac and Hiccinsv 197^; 
Tenpas, Reiser, Kearn^j, Booth & Deden, 197^) which found that cues and examples, rather 
than practice or feedback, made the major contribution to subject posttest performance. 
Tlie apparent inconsistency between the results of this research and the Tenpas and 
uiCCms findincs may be related to the nature of the instructional task or the way in 
which concepts were presented in the instruction. In the Tenpas research, the instruc- 
uion for an aircraft instrument comprehension taslc consisted of new applications for 
familiar concepts which were presented both visually and verbally. For this task, a 
cue and several e::anples were sufficient for the subject to acquire the new concepts. 
In contrast, when the instructional task consisted of learninc a new concept and classi- 
fyinc new instances of the concept, such as in the present study, cues and e:Kunples were 
not_ effective. However, when practice and feedback components were added to the in- 
struction, subjects performeu the classification taslc sicnificantly better. It seems 
likely that practice and feedback become more effective in facilitating concept acqui" 
sition when the subject must learn both new terminolocy related to the concept and 
application of the concept, rather than just learning to apply new concepts based on 
familiar terminolocy. 

One important finding from the results of tlie present study was the cur.mlative 
effect that conbininc cues, examples, practice items, and feedback had on learninc new 
concepts and their applications. However, it appears froi;. the present research and 
from earlier findings that the individual effects of these four instructional compo- 
nents may vary with the type of task. Tlie necessary information and sldll for some 
instructional taslcs U apparently acquired prior to receiving practice and feedback, 
in such cases, practice and feedback have little potential for improving the subject's 
acquisition of the concept « However, in cases such as the present study when instruc- 
tion does not enable the subject to acquire and apply the concept, practice and feed- 
back moy result in improved acquisition of the concept. Research involving different 
types of learning tasks should help to indicate the e::tent to which the effects of 
feedback and practice are specific to particular types of tasks. 
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TABLE 1 

POSTTEST liEAM SCORES BY TRETiTiaSHT AuD SUBTEST 



Treatment 






Subtest 


Section 






Totol 




1 




3 




5 







Control 


if .18 




^.71 


6.32 


6.39 


6.00 


3^.1^ 


Cues 




7.75 




7.36 


6.68 


6.11 


38.29 


Cuefi*E::or.iple6 


6.39 


7.1^ 


5.57 


5.97 


6.72 


6.39 


38.18 


Cues^Fractiee 


5.96 


8.57 


5.32 


7.61 


7.68 


7.25 


^2,39 


Cues«>E:{eiinple8~ 
Practice 


6.21 


8.29 


5.29 


7.21 


7.36 




^.82 


Cues^Exomples- 
PraeticevFeedbeiok 


7.18 


9.18 


7.1^ 


8.86 


8.78 


7.18 


^.32 
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TABLE 2 



L-TEST SUiaiARY TABLE FOR POSTTEST SCORES 
BY TREATIiEMT AIH) SUBTEST 



Subtest Treatment 



Section 


CEPP 


CEP 


CP 


GE 


C 


Control 


1 


2 


3 




5 




1 


X 


3 


it 


2 


5 


6 


2 


1 


3 


2 


5 




6 


3 


1 




3 


2 


5 


6 




1 


k 


2 


6 


3 


5 


5 


1 


3 


2 




5 


6 


6 


2 


3 


1 




5 


6 


Sur.i 


7 


20 




23 


27 


35 


Sutn Rank 


7 


'fO 


42 


92 


135 


210 s 526* 



* L a 526, p <.01 



Note.— Tlie troatwents are arranged from left to ricilit across the colutms 
of the tabke in their order of predicted effect on podtteet performance. 
For e::ar.iple, the CEPF croup is in the far left colurn because it was 
e^Tjectod to yield the hichest performance. The rows of the table repre- 
sent the subtest sections. Entries in each cell under a trentnent rroup 
show the observed rani: order of performance of that croup on the subtest 
section represented by that cell. T«ad, it con be seen that the CEPF 
croup ranked highest of any croup (a ranl« of 1) on subtest sections 1-5 
and second hichest on section 6. 
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